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AdvertiamBnt Monitoring Axid Feedback Systm 



Buofcgreund ^ tlx* invention 

5 Cable television service pjcovidere have typically provided 

one-way broadoaet servicee but now ofCet high-speed data 
services and can combine traditional analog broadcasts with 
digital broadcast 3 and access to Internet veb sites. Telephone 
companies can offer digital data and video programming on a 

10 switched basis over digital subscriber line technology. 

Although the subscriber may only be presented with one channel 
at a time, channel change requests are iTietantaneously 
transmitted to centralized switching eqaipment and the 
subscriber can access the programming in a broadcast-like 

15 manner. Internet Service Providers (ISPs) offer Internet 
access and can offer access to text^ audio^ and video 
programming which can also be delivered In a broadcast- like 
manner in which the subscriber selects ""channels'^ containing 
programming of interest. Such channels may be offered as part 

20 of a video programming service or within a data service and can 
be presented within an Internet browser. 

Advertisements are a part of daily life and certainly an 
important part of entertainment programming^ where the payzckents 
for advertisements cover the cost of network television. A 

25 method/ which provides a flexible billing plan to cable network 
users based on the amount of advertisements viewed is described 
in U.S. Patent Ho. 5,532^735/ which discloees a method of 
advertisement selection for interactive services. A user 
associated with an interactive TV is presented with a program 

30 and a set of advertisements. The user can indicate the amount 
of advertissments in the set of advert! eementa he wants to 
view. 

While advertisements are sometimes beneficial to 
subscribers and deliver desired information regarding specific 

1 
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U<S. Patent No. 5r 608; 445 dlecLosea a method and device for 
data capture In television viewer research. Devices are 
attached to a video installation in order to determine to which 
channel a set is tuned. 
5 With the advent of the Internet, manufacturere and service 

providers have found ways to selectively inaert their 
advertisements based on a SMbBoril>er6 requests for infortxtation. 
A9 an example, an individual who eeaxcheB for ^^oars'' on the 
Internet my see an advertisement for a particular type of car, 
10 Various internet-baeed advertisers use this method. The 
product literature from IMGXS Inc./'' Ad Force," printed from 
the World PJide Web site 

http; //www, starpt^ com/ cor e/ad^Target. html on Juoe 3pi 1998 
discloses an ad targeting system. The system delivers ads to 

15 web site visitors based on the content of the web page^ time of ' 
dayr day of the week, keyword, by the number of tiraea a visitor 
sees an advertisement and by the order in which a series of 
advertisements are shown to a visitor, Nevertheless, unless 
the subscriber actually goes to the advertised web site, there 

20 19 no way to determine If the advertisement has been watched. 
Ab the content on the Internet migrates to multimedia 
programming including audio and video, the costs for the 
advertising will increase/ but unless the advertiser can be 
sure that a significant percentage of the message was watched 

25 or observed, the advertising is ineffective. Prior art 

products for generating reports of ad campaigns are generally 
PC-centrio as described in various product literature which 
include the product literature from Doubleclick Inc., 
"DoubleClicX; Reporting/'' printed from the World Wide Meb [Wm) 

30 site http; //www. doubleclick.net/dart/howi_repo. htm on June 19, 
1998, which discloses the reporting capabilities of 
Doubleclick's Dynamic Advertising Reporting & Targeting (BART) 
product. The information in the reports includes daily 
impressions by advertisement type, average impreasion per day 

3 
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In order to deliver more targeted progrartiming and 
advertising to subscribers^ it is neceseary to understand tbelx 
likes and disliked to a greater extent than xb presently done 
today I Systems which Identify subscriber preferences baaed on 

5 their purchases and responses to questionnaires allow for the 
targeted marketing of literature in the mail^ but do not in any 
sense allow for the rapid and precise delivery of pxograncaing 
and advertising which is known to have a high probability of 
acceptance to the subscriber. Other systems give users the 

10 possibility to choose their programming as described in O.s. 
Patent No. 223 r 524 which discloses a system and method for 
automatically correlating user preferences with a TV program 
information database. The systeiti includes a processor that 
performs ^'free text" search techniques to correlate the 

15 downloaded TV program Information with the viewer^ s 

preferences. This system requires an interaction between the 
users and the programming. The white paper from Net 
Percepticna corporation entitled "Adding Value in the Digital 
Age" and printed from the World Wide Web site 

20 http: //www. netperceptione p com/product s/white-papers .html on 
June 3D, 1998 disoloses how the GroupLens Recommendation Engine 
gives online businesses the ability to target and personalize 
services f content, products and advertising. A learning 
process learns personal information about an individual using 

25 explicit and implicit ratings, a prediction process predicts 
user preference using collaborative filtering and the 
recomttendation process recommends products or services to users 
based on predictions « 

The product literature from Aptex Software Inc., 

30 ^^SelectCast for Commerce Servers," printed from the World Wide 
Web site http://wvw.aptex.com/products-selectcast-commerce, htm 
on June 30i 1998 describes the product '^SelectCast'' for 
Commerce Servers. It personalizes online shopping baaed on 
observed user behavior. Oser interests are learned based on 

5 
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relationahip-based context vectors based on word proximity and 
co-import anoe. Geometric relatioiifihlps among context vectors 
axB repressntative of conceptual relationships among their 
associated items, 
5 The product data sheet from Open Sesame, ^^Learn Sesame,'' 

printed izm the World Wide Web site 
http; //www, opense8an1e.com/prod_a4 1 html on July 09/ 1996 
discloses Open Sesame' s personalization product for Web 
enterprises. It learns about users automatically from their 

ID broHsing behavior. 

The product literature from Bagage Technologies/ 
''Engage. Discover/"' printed from the World Wide Web site 
http://www.engagetBch,cora on July 09, 1998 discloses Engage 
Technologies'' product for user profiling . Ueer-disclosed 

15 information such as interest; demographics and opinions are 
combined with anonymous clickstream data that describes wfaers 
users come from before visiting the site^ how long they stay, 
and what pages or types of pages they visit most frequently to 
build the visitor profile, 

20 The marketing literature from BroadVision/ ^^The Power of 

Personalization^'/ printed from the World Wide Web site 
http://www.broadvision.caiii/content/oorpor8te/brochure/Broch4*ht 
iti on August 21/ 1998 discloses the BrcadVision One-to-One • - 
application profiling system, The system learns about users 

25 through a variety of techniques including registration^ 

questionnaires / observation and integration of historical and 
externally generated data. 

The ttiarlceting literature from the Firefly Corporation/ 
^Firefly Passport Office/^ printed from the World Wide Web site 

30 http:/ /www. firefly, net /company/ Passport Of fice.html on June 20, 
1998 discloses Firefly's RelationsJiip Management software. The 
software enables online businesaea to create; extend and manage 
personal profiles for every user, 

7 
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system. The EPG data includes guide data^ channel data and 
program data. The program data includea ainong other 
information f the program title; the program category/ the 
program aob-categoxy and a detailed deecription of the program. 
5 Some efforts have beet\ made to transmit targeted 

advertisements and thereupon collect feedback on the 
tranamitted advertisements. For eKample, U.S. Patent 
No. 5/ 948/ 061 provides methods and apparatuses for targeting the 
delivery of advertisement a over a network such aa the Internet. 

10 Statlatica are cc^lled on individual users and networka and 
the XLse of the advertisements is tracked to permit targeting of 
the advertis^ents to individual users. In response to 
requests from affiliated sites, an advertising server transmits 
to people accesBing the page of a site an appropriate one of 

15 the advertisements based upon profiling of users and networks. 

Furthermore^ U.S. Patent Ho. 6r 005, 597 provides a method 
and apparatus for television prograjn selection that monitors 
the viewing preferences of a viewer to create a dynamic viewer 
profile that is used to rate available programs. Based on the 

20 viewer profile^ available programs are sorted and presented to 
the viewer in descending order of predicted interest » The 
invention allows a viewer to quickly find the program of 
greatest interest to the viewer without having to tediously 
search through large numbers of available programs* The 

25 invention maty also be used for selecting from among a plurality 
of programs other than television programs ^ such as; for 
example/ radio programs or audio or video programs stored on 
digital storage media auch as CD's and DVD's* 

CJ.S. Patent No. 5; 446/ 919 provides a communication system 

30 capable of targeting a demographically or psycbographically 
defined audience, h master database is maintainedr containing 
demographic and psychographic information about each audience 
member. Thia information is transmitted and stored In a 
channel selection/decoder unit associated with each audience 



5/4/05, EAST version: 2.0.1.4 



wo 01/65747 PCT/US01/064S9 

a remote control r dovmloadecl to a subscribdr's converter from a 
remote head-end, or prograinmed into tlie converter at 
instaUatlon. Prioritization of the demographic 
characteristics of a plurality of television viewers watching a 

5 prbgram together enables coromeroials to be targeted to the 
viewer having highest priority. Statistical data can be 
maintained concerning the number and identity of subscribers 
viewing specific coinmercials. 

U.S. Patent No* 5,774/170 enhances television (and radio) 

10 advertising by targeting, delivering and displaying electronic 
advertising messages (coromeroials} within specified programming 
in one or more pre-determined households (or on specific 
display devices) whi'le simultaneously preventing a cormnercial 
from being displayed in other households or on other displays 

15 for vbich it is not intended. C(»ranBroiala can be delivered to 
specified honies or displays via either over-the-alr ox wired 
delivery systems. 

0,S» Patent No. 5,446^919 provides a ooxamuni cation system 
capable of targeting a deraographically or psyahographioally 

20 defined audience. A master database is maintained, coataining 
demographic and psychographic information about each audience 
member. This information is transmitted and stored! in a 
channel selection/decoder unit associated with each ao^dience 
member's receiver. Multiple media messages are transmitted to 

25 each audience member. Accompanying the transmission is a 
selection profile command^ which details the 
denK>graphic/pBycbographic profile of audience members that are 
to receive each media message. The channel selector/decoder 
unit associated with each member's receiver compares the 

30 selection profile with the demographic/psychographic 
information about the audience member and selects the 
appropriate media message for that audience member. 

IEEE Publication: Traroework for Targeting Banner 
Advertising on the Internet'' by K.Gallagher and J. Parsons, 

11 
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and generates one or more records of the subscriber advertising 
selection data. Ii^ a preferred embodiment, the subscriber 
advertising selection data includes the channel s sleeted and 
tbe time at which the channel was selected. Advert is enient 
b related information including the type of product; brand name/ 
and other descriptive information that categorizes the 
advertisement is also extracted and added to the advertising 
selection data. The advertisement related Information might 
also be extracted frcsa the closedo-captioning text. Based on 

10 this advertisement selection data, a record is created 

documenting what percentage, if any, of the advertisement vras 
watched, This record is- then fed back to the subscriber 
characterization Byetem, wherein the subscriber 
characterization system may comprise one or more filters* 

IS The subscriber characterization system also monitors the 

aubscxiber viewing habits associated with program viewing and 
generates one or more records of program selection choices « 
The program selection choices include the viewing time 
duration, number of channel changes, volume at which the 

20 programming is listened, program selection, and text 

information about the programming. The records are used to 
determine what type of programming the subscriber is most 
interested in. The subscriber characterization system 
characterizes subscribers based on feedback infoxTnation from an 

25 advertisement monitoring system and monitors their detailed 
program viewing selections. 

Furthermore, the subscriber characterization system is 
equipped with one or more filters that asaiat in determining 
and eliminating from consideration, selection data associated 

30 with Irrelevant activities by the subscriber. Examples of 
irrelevant actlvitiea include seleotion data associated with 
channel surfing and/or channel jumping (up and down) 
activities. 

The channel surfing activity refers to one or more rapid 

13 
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progrEanmlng. The reaaoas for such ciead periods may be caused 
by the fact that th© subscriber has left the rocnnr or the 
subscriber is not active (e.g.p the subdcriber has gone to 
sieep or has do^ed off), or th© fact that the subscriber is 
5 actively engaging in another activity within the room and is 
not attending to the programming, 

The subscriber characterization system of the present 
invention analyzee the actual viewing selections made by the 
subscriber or the subscriber householdf and generates a 

10 demographic description of the subeoriber or household . This 
demographic description describes the probable age, income, 
gender and other demographics. The resulting characterization 
includes probabilistic determiaations of what other pxograinming 
or products in which the subscriber/household will be 

15 interested. 

In a preferred sinbodiment, the text information related to 
the advertisement is processed using context mining techniques 
which allow for classification of the advertisement asd 
extraction of key data including product type and brand. 

2D Context mtning techniques allow for determination of a product 
type, product brand name and in the case of a product which is 
not sold with a particular brand' name, a generic name for the 
product. 

The present Invention can also be realized in a client- ' 
25 server mode in which case the advertising related information 
is collected at the client side of the network and is then 
transmitted to the server side via a secure connection. The 
server side then incorporates this information with other 
subscriber information to create subscriber profiles, 
30 These and other features and objects of the invention will 

be more fully understood from the following detailed 
description of the preferred embodiments which should be read 
in light of the accompanying drawings, 

IS 
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FIG. BB illustrates a flowchart for program 

characterization; 

FIGS. 9A illust rates a doterministio prograin category 

vector; 

5 FIG. 9B illustrates 9 determlDistlc prograici sub-category 

vector; 

FIG. 9C illuetratea a determiisiBtlc program rating vector; 
FIG. 9D illustrates a probabiliBtic program category 
vector; 

10 FIG. 9B illustrates a probabilistic program sub-categoxy 

vector; 

FIG. 9F illuetratea a probabilistic program content 
vector; 

FIG. lOA illustrates a set of logical heuriatic rules; 
15 FIG. lOB illustrates a set of heuristic rules expressed in 

terms of conditional probabilities; 

FIG. 11 illustrates an entity-relationehip diagram for the 
generation of ♦program demographic vectors; 

FIG. 12 illustrates a program demographic vector; 
20 FIG. 13 Illustrates an entity-relationship diagram for the 

generation of household session demographic data and household 
session interest profiles; 

FIG. 14 illustrates an entity-relationehip diagram for the 
generation of average and session household demographic 
25 characteristics; 

FIG. 15 illustrates average and session household 
demographic data; 

FIG, 16 illustrates an entity-relationship diagram for 
generation of a household interest profile; 
30 FIG* 1*? illufitratea a household interest profile Including 

programodng and product profiles; 

FIG, 18 illustrates a client-server architecture for 
realizing the present invention; and 

FIG, 19 illustrates an advertisement monitoring table. 

17 
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d3 they relate to actual prcgranuning information* SCSF 104, 
based on advertising related ii^formation and the actual, 
prograroming ii^forxnation, generates one or more subacriber 
profiles 106 f wherein each aubsari]>ex profile indicates a 
5 probabilistic measure of subscriber demographica and/or 
preferences . 

Aa illustrated in TlG, IB, in generating one or more 
records of advertisement eelectionsr the AMS 1D2 receivea from 
a subscriber 12 OA commands in the form of a volume control 

10 signal 124A or advertising selection data 122A which can be in 
the form of a channel change, The advertising material being 
viewed by the subscriber 120A is referred to as source material 
130A. The source material 130A^ aa defined herein, is the 
content that a subscriber selects and n^y conaiat of analog . 

15 video, Motion Picture Expert Groi^p (MPEG) digital video source 
materialr other digital or analog material. Hypertext Markup 
Language {WTML} or other type of multimedia source inaterlal. 
The AMS 102 can access the source material 130A received by the 
subacriber 120A using a start signal 132A and a stop sigrial 

20 134A, which control the transfer of source related text 136A 
which can b© analyzed as described herein. 

In a preferred embodiment, the source related text 136A 
can be extracted from the source material 130A and stored in 
memory. The source related text 136A, as defined herein, 

25 includes source related textual information including 

descriptive fields which are related to the source matejtial 
• 130A, or text which is part of the eource material 130A itself. 
The source related text 136A can be derived from a nuniber of 
sources including but not limited to cloaed-captioning 

30 information. Electronic Program Guide (BPG) material, and text 
information in the source itself (e.g. text in HTML files). 

An Electronic Program Guide (EPG) 14 OA contains 
information related to the source material 130A which is useful 
to the subscriber 120A. The EPG 140A is typically a 

19 
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In the process of collecting raw sxibacrib&r selection 
data, the SCSF 10^ receives from a subscriber 120B contmande In 
the form of a volume control signal 124B or program selection 
data 12 2B which can be in the form of a channel change but may 
5 also be an address request which requests the delivery of 
programming from a network address, A record signal 126B 
indicates that the programming or the address of the 
programming is being recorded by the fiubecriber 120B« The 
record signal 12 6B can also be a printing command , a tape 

10 recording command ^ a bookmark comDiand or any other command 

intended to store the program being viewed^ or program addressr 
for later use. 

The material being viewed by the subscriber 120B is 
referred to as source material 130B. The so-arce material 130Br 

15 as defined herein^ is the content that a subscriber selects and 
may consist of analog video, digital video such as MPEG digital 
video, Hypertest Markup Language (HTML) r or other types of 
multimedia source material. The SCSF 104 can access the source 
material I30B received by the subscriber 120B using a start 

20 eignal 132B and a stop signal 134B, which control the transfer 
of source related text 136B which can bo analyzed as described 
herein* 

In a preferred embodiment i the source related text 13 6B 
can be extracted from the source material 130B and stored in 

25 memory. The source related text 136B, as defined hereini 
includes source related textual information including 
descriptive fielde which are related to the source material 
130Bf or text which is part of the source material 130B itself. 
The source related text 136B can be derived from a number of 

30 sources including but not limited to closed- captioning 

information, BP6 material, and text information in the source 
itself (e.g., text in BTMIi files). 

The EP<3 14 OB contains information related to the source 
material 130B which is useful to the subscriber X2DB. The BPG 

21 
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selection data assooiatecl with channel surfing, channel junking 
and dead periods is eliminated from the advertisement and 
program selection data to generate actual aubecriber selection 
data 199. TIG. ID aod the related text describe this proceaa 
5 in details 

The actual subaoriber selection data 199 coic^risea time 
ll2Cr which corresponds to the time cf an actual viewing event 
exclusive of channel surfing r channel jumping or dead periods, 
channel ID ll^C, program ID 116C, program title 11 7C, volume 

10 level IIBC, and channel change record 119C. 

Based on the actual eul^soriber selection data I9d| the 
SCSF 104 generates one or more program characteristics vectors 
150 which are comprised of collected char'aoteristicB data 152. 
The oharacteriatica data 152, which can be used to create the 

15 program characteristics vectors L50, both in vector and table 
form, are examples of source related information which 
represent characteristics of the source material (for the 
advertisements and the programs) . The characteristics vectors 
. 150 are derived from the source related text 136B and/or from 

20 the EPG IflOB by applying information retrieval techniques. The 
details of this process are discussed in detail later* 

Xn a preferred embodiment, the characteristics vectors 150 
are lists of values which characterize the programming (source) 
material in accordance to the category 14 4B, the sub-category 

25 146B, and the program description 14 8B. The present invention 
may also be applied to advertisements, in which case program 
characteristics vectors contain^ as an example, a product 
category/ a product sub-category, and a brand name. 

As illustrated in PIG. IC, the SCSF 104 used heuristic 

30 rules 160* The heuristic rules 160, as described herein, are 
composed of both logical heurietic rules as well as heuristic 
rules expressed in terms of conditional probabilitiea. The 
heuristic rules 160 can be accessed by the SCSF 104 via a 
request rules signal 162 v/bich results in the transfer of a 

23 
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generate actual subscriber selection data 199 which does not 
include irrelevant selection data^ The irrelevant selection 
data generally corresponds to channel suirfing, channel jujnpingr 
or dead periods activities. These activities are generally 
5 recognized by reviewing corresponding viewing times, in the 
case of channel aurflng or channel jumping, the associated 
viewing times are very brief, a few milli seconds or a few 
seconds » In the case of dead periods,^ the viewing time is 
relatively long having no actions , e.g./ a few hours. 

10 FIG. 2 illustrates an exemplary system for monitoring 

Bubsoriber activities, including advertising viewing habits, 
and can be used to realize the AMS 1D2 ancl the SCS? IQ4. in a 
preferred e^tibodiment, the monitoring system of PIG. 2 is 
located in a television set-top device ox in the television 

15 itself. In an alternate embodiment, the monitoring system is 
part of a computer which receives programming from a network. 

In an application of the system for television services, 
an input connector 220 accepts the video signal coming either 
from an antenna, cable television input, or other network. The 

20 video signal can be analog or digital, evch as W?BG. 

Alternatively, the video source may be a video stream or other 
multimedia stream from a communications network including the 
Internet. 

In the case of either analog or digital video, selected 
25 fields are defined to carry BPG data or cloaed-captioning text^ 
For analog video r the closed-captioning text is embedded in the 
vertical blanking interval (VBI) . As described in OS Patent 
5,579,005, assigned to Scientific-Atlanta, Inc., the BPG 
information can be carried in a dedicated channel or embedded 
30 in the VBI. For digital video, the closed-captioning text is 
cacried as video subscriber bits in a subscriber_data field. 
The EFG data is transmitted as ancillary data and is 
multiplexed at the transport layer with the audio and video 
data. 
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call signr program name and other useful data are provided, In 
a praferr^ embodiment, tb^ data stream is stored in a reserved 
location of the RAM 204. In an alternate embodiment, a 
magnetic disk is used for data storage. The system control 
6 unit 200 write© in a dedicated memory, which in a preferred 
embodiment ia the* RAM 204, the selected channel, the time of 
selection, the volume level and the program ID and the program 
title. Upon receiving the program selection data, the new 
selected channel is directed to the channel processor 210 and 

10 the system control unit 200 writea to the dedicated memory the 
channel ee lection end time and the program title at the time of 
channel change. The system control unit 200 keeps track of the 
number of channel changes occurring during the vieirtng time via • 
the channel change record* This data forms part of the 

15 advertising selection records llOA or the programming selection 
records llOB. 

The volume control signal is sent to the audio processor 
240. In a preferred embodiment/ the volume level selected by 
the subscriber corresponds to the listening volume r In an 

20 . alternate embodiment, the volume level selected by the 
subscriber represents a volume level to another piece of 
equipment such as an audio system (home theatre system} or to 
the television itself » In such a case, the volume can be 
measured directly by a microphone or other audio sensing device 

2b which can monitor the volume at which the selected source 
material is being listened. 

. A program change occurring while watching a selected 
channel is also logged by the system control unit 200. 
Monitoring the content of the program at the time of the 

30 program change can be done by reading the content of the EDS. 
The EDS contains information such as program title, which is 
transmitted via the VBI. A change on the program title field 
is detected by the monitoring system and logged as an event, 
In an alternate embodiment ^ an EPG is present and program 
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FIG, 4 illustrates an exeonplary block diagraB of a 
computer sygtem for a realization of the subscriber monitoring 
fiystem illustrated in FIG. 2. A system bus 422 transpoxta data 
amongst the CPU 203^ the RAM 204/ a Read Only Memory - Basic 
5 I:nput Output ayatem (ROM-BIOS) 406 and other oomponents. The 
CPO 203 accesses a hard drive 400 through a disX controller 
402. The standard input/output devices ere connected to the 
system bus 422 through the I/O controller 201. A keyboard is 
attached to the I/O controller 201 through a keyboard port 416 

10 and the monitor is connected through a monitor port 41S. The 
aerial port device uses a serial port 420 to communicate with - 
the I/O controller 201. Industry Standard Architecture (ISA) 
expansion slots 40B and Peripheral Component Interconnect (PCI) 
expansion slots 410 allow additional cards to be placed into 

15 the computer. In a preferred embodimentf a network card is 
available to Interface a local area; wide area, or other 
network. 

FIG. 5 illustrates a channel sequence and volume over a 
twenty-four (24) hour period associated with advertisement 

20 selection record llOA or subscriber selection record HOB. The 
Y-axis represents the status of tie receiver in terms of on/off 
status and volume level* The X-axis represents the time of 
day. The channels viewed are represented by the windows 501- 
506^ with a first channel 502 being watched followed by the 

25 viewing of a second channel 504, and a third channel 506 in the 
morning. In the evening a fourth channel 501 is watched, a 
fifth channel 503^ and a sixth channel 505. A channel change 
is illustrated by a nvoinentary transition to the ""off" status 
and a volume change is represented by a change of level on the 

30 Y-axis. 

A detailed record of the advertising selection record llOA 
and/or prograjrtming selection data HOB is illustrated in fig. 
6A in a table format. A time column 602 contains the starting 
time of every event occurring during the viewing time. A 
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Similarly, the viewing record also indicate? that the, 
corresponding viewing ttmeg of each of channel nvznber^ 1, if 9/ 

blf 56^ 55, 54 r 53 are about a minute or less. Thie 
in^lies that after the subscriber had completed the viewing of 
5 channel number 6, the subscriber once again eurfed the channels 
to find a programming of interest at channel 25/ which waa 
viewed for about 10 minutes. 

FIG, 6C illustrates proceaaing involved in the elimination 
of viewing tiiaee associated with the channel jumping 
10 activities. The channel jumping activity is different than a 
channel surfing activity in a sense that the subscriber- already 
Xnowa the intended programming (and corresponding channel 
. nuinber) he wants to watchi and utilizes the channel up or 
channel down button to arrive at the intended channel. 
15 The viewing time of all the intermediate channels during 

channel jumping activity are generally very brief (less than a 
second) , Also, as the channel up or channel down button is 
utilized to reach the desired channels, generally, there exists 
an upwards or a downwards stream of channel changes/ i.e./ the 
2D subscriber may jump through cbannela 2^ 3, i and 5 to reach 
channel nuiciber 6 (an intended channel) . Similarly, subscriber 
juinps may through channel 1, 6f 9; 10, 11; 12, 13, Uf 15, and 
16 to reach channel 17. 

The filters of the present invention are configured to 
25 eliminate the channel jumping data trm the actual viewing 

data. Filters generally evaluate the associated viewing times, 
and all the viewing timee which correspond to channel jumping, 
e-g,, are leas than one second, are removed from the viewing 
records* 

30 The filters are also configured to eliminate data 

associated with dead activities; e.g., extended spaas of 
inactivity. These extended spans of inactivity indicate that 
the subscriber is not actively watching the programming, e.g., 
the subscriber has left the room, has gone to sleep; or is 
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Statistical record contains the totals for the items listed in 
the minutes watched column 702, the channel* changes column 704 
and the average volume 706. 

PIG. 8A illustratep an entity-relationship diagram for the 
5 generation of the characteristics vector 150. The context 
vector generation and retrieval technique can be applied for 
the generation of the characteristics vectors 150 which ia 
described in OS Patent 5, 619,709» Other techniques are well 
known by those skilled in the art. 

ID a*he source material 130 or the QP€ 140 is passed through a 

characterization processing 600 to generate the character ist ice 
vectors 150, The characterization processing 800 is described 
in accordance with FIG. 8B. The content descriptors including 
a first content descriptor 802, a second content descriptor 804 

15 and an nth content descriptor B06f each classified in terma of 
the categoryr the sub-categoryr and other divisions as 
identified in the industry accepted program classification 
system, are presented to a context vector generator 820. As an 
example/ the content descriptor can be text representative of 

20 the expected content of material found in the particular 

category ^program and/or advertisement) . In this example, the 
content deacrlptors 802, B04 and 806 would contain text 
representative of what would be founsl in programs in the liews; 
fiction, and advertis'ing categories respectively. The context 

25 vector generator 620 generates context vectors for that set of 
aaraple texta resulting in a first suinmary context vector 808, a 
second eumary context vector 810^ and an nth sunimary context 
vector 812. In the exaniple given, the summary context vectore 
BOB, 810^ and 812 correspond to the categories of nev^s, fiction 

30 and advertising respectively. The suinmary vectors are stored 
in a local data storage system. 

K sample of the source related text 136 which is 
associated with the new program to be classified is passed to 
the context vector generator 820 which generates a context 
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The program characteristics vectors 150 in general are 
repre Banted in EIGS. 9A through 9F. PIGS, 5A, 9B and 9C are an 
example of deterministic vectors. This aet of vectors is 
generated when the program charaoteriatica axe well defined, as 
5 can occur when the source related text 136 or the EPG 140 
contains specific fields identifying the category and the sub- 
category. A program rating can also provided by the EPG 140- 
In the case that these characteristics are not specified, 
a statistical set of vectors is generated from the process 

10 described in accordance with FIG. B. FIGS. 9D-9F illustrate 
the probability that a prograni being watched is Zxm the given 
category and program classification, respectively. 

PIG. IDA illustrates sets of logical heuristics rules 
which form part oC the heuristic rules 160. In a preferred 

15 embodijneat, logical heuristic rules are obtained from 

sociological or psychological studies. Two types of rules are 
illustrated in FIG. IDA. The first type links an individual's 
viewing characteristics to demographic characteristics such as 
gender, age, and income level. A channel changing rate rule 

20 1030 attempts to determine gender based on channel change rate, 
An income related channel change rate rule 1010 attempts to 
link channel change rates to income brackets. A second type of 
rules links particular programs to particular audience, as 
illustrated by a gender determining rule 1050 which links the 

25 program category/sub-category with a gender. The result of the 
application of the logical heuristic rules illustrated in FIG. 
lOA are probabilistic determinations of factors including 
gender/ age, and income level. Although a specific set of 
logical heuristic rules has been used as an examplSf a wide 

30 number of types of logical heuristic rules can be used to 

realize the present invention. In additionr these rules can be 
changed based on learning within the system or based on 
external studies which provide more accurate rules, 
PIG, lOB illustrates a set of the heuristic rules 
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r\:ile. This probability is the sum of the conditional 
probabilitids that the demographic group likea the prograrPr 
conditional to the category 14 weighted by the probability 
that the program ie from that category 144, In a preferred 

5 ecobodiment, the program target analysis can calculate the 
program demographic vectore by the application of logical 
heuristic rules 160, aa illustrated in WIG, lOhf and by the 
application of heuristic ruled expreaeed aa conditional 
probabilitie^s as shown in FIG. 103. Logical heuristic rules 

10 can be applied ueirlg logical programming and fuzzy logic using 
techniques well understood by those slcilled in the art; and are 
discussed in the text by S. V. Kartalopoulos entitled 
^^Understanding Neural Networks and Furzy Logic. 

Conditional probabilities can be applied by simple 

15 mathematical operations multiplying program context vectors by 
matrices of conditional probabilities. By performing this 
process over all the demographic groups, the target analysis 
process 1100 can measure how likely a program is to be . of 
interest to each demographic group. Those probabilities values 

20 form the demographic vector 170 repreaented in FIG»12. 
hs an example, the heuristic rules expressed as 
conditional probabilities shown in FIG. lOB are used as part of 
a matrix multiplication in which the program characteriatica 
vector 150 of dimension N, such aa those shown in FIGS. 9A-9F 

25 is multiplied by an N x M matrix of heuristic rules expressed 
aa conditional probabllitiesr such as that shown in FIG. lOB. 
The 'resulting vector of dimension M is a weighted average of 
the conditional probabilities for each category and represents 
the household demographic characteristics 190. Similar 

30 processing can be performed at the sub-category and content 
levels. 

FIG« 13 Illustrates an entity-relationship diagram for the 
generation of housebold session demographic data 1310 and a 
household seasioo interest profile 1320. In a preferred 
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actual subscriber selection data 199^ and the heuristic rules 
160 are applied. In the case of logical heuristic rules as 
ahown in FIG. lOA, logical programming can be applied to make 
determinations regarding the household session demographic data 
5 1310 and the household session interest profile 1320. In the 
case of heuristic rules in the form of conditional 
probabilities such ae those illustrated in HQ. lOBr a dot 
product of the time averaged values of the program 
charaoterletice vectors ISO oan be taken with the appropriate 

10 matrix of heuristic rules 1$0 to generate both the household 
aeasion demographic data 1310 and the household session 
interest profile 1320. 

Volutue control measurements which form part of the 
subscriber selection data llOA and HOB can also be applied in 

15 the session characterisation process 1300 to form a household 
session interest profile 1320. This can be accomplished by 
using normalized volume measurements in a weighted average 
manner similar to how time duration is used. Thus, muting a 
show results in a 2ero value for volumei and the program 

20 characteristics vector 150 for this show will not bs averaged 
into the household session interest profile 1320. 

FIG. 14 illustrates an entity-relationship diagram for, the 
generation of average household demographic characteristics 190 
and- session household demographic characteristics 190. A 

25- household deirographic characterization process 1400 generates 
the household demographic characteristics 190 represented in 
table format in FIG. 15. The household demographic 
characteriiation process 1400 uses the household viewing haJtjits 
195 in combination with the heuristic rules 160 to determine 

30 demographic data. For example^ a household with a number of 
minutes watched of zero during the day may indicate a household 
with two working adults. Both logical heuristic rules as well 
as rules based on cozsditional probabilities can be applied to 
the household viewing habits 195 to obtain the household 
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the household interest profile 180 which takes into account 
both the viewing preferences of the household as well as 
asaumptions about houaeholds/subscrlbers with those viewing 
habits and program preferences, 
5 FIG. 17 illuetratea an exemplary houaehold interest 

profile 180 that includes a programming types row 1709, a 
prodvcta types row 1707, a household interests column 1701, an 
average value column 1703, and a session value coluzm 1705. 
The product typea row 1707 gives an indication as to what 

10 type of advertleement the houaehold would be interested in 
watching, thus Indicating what typea of products could 
potentially be advertised with a high probability of the 
advertisement being watched in its entirety. The prograMiing 
types row 1709 suggests what kind of programming the houaehold 

15 is likely to be interested in watching. The houaehold 

interests column 1701 specifies the types of programming and 
products which are statistically characterized for that 
household, 

As an example of the industrial applicability of the 
20 invention; a household will perform its normal viewing routine 
without being requested to answer specific questions regarding 
likea and dislikes. Children may watch television in the- 
morning in the household/ and may change channels during 
commercials/ or not at all. The television may r^ain off 
' 25 during the working day, while the children are at school and 
day care J. and be turned on again in the evening, at which time 
the parents may "^surf' channels/ mute the television during 
commercials, and ultimately watch one or two hours of broadcast 
programning. The present invention provides the ability to 
30 characterize the houaehold, and may make the determination that 
there are children and adults in the household, with program 
and product interests indicated in the household interest . 
profile 180 corresponding to a family of that composition. A 
household with two retired adults will have a completely 
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ie dleplayftd on PC 1820 or television 1810 according to which 
device ntade the request. 

According to one* embodiment, the server side maintalne the 
advertising selection data llOA aisd subscriber selection data 
5 llOB which it is able to compile based on its operation as a 
proxy for the client side. Retrieval of source related 
information 130, the program target analysis process llOO, the 
program characterization process BOO, the aession 
characterization* process 1300, the household demographic 
ID characterization process 1400, and the household interest 
profile generation process 1600 can be performed by server 
1840, 

Referring to FIG. 19 an advertisement monitoring table is 
illustrated, in which an advertisement ID (AD ID) column 1915 

15 contains a numerical id for an advertisement which was 

transmitted with the advertisement in the form of a Program ID, 
http address, or other identifier which is uniquely associated 
with the advertisement. A product column 1921 contains a 
product description which indicates the type of product that 

20 was advertised, A brand column 1927 indicates the brand name 
of the product or can alternatively list a generic name lor 
that product. A percent watched column 1933 indicates the 
percentage of the advertisement the subscriber viewed. In an 
alternate embodiment, a letter rating or other type of rating 

25 is used to indicate the probability that the advertisement was 
watched. A volume column 1937 indicates the volume level at 
which the advertisement was watched. 

As an example of the industrial applicability of the 
invention; a manufacturer may develop an advertising strategy 

30 which includes the Insertion of advertisements during popular 
evening programs. The costs for such ad insertions can be 
extremely high. In order to insure the cost effectiveness of 
this advertising strategy^ the manufacturer has the 
advertisements placed during leee watched but similar programs 
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Claims 

i^ihat is clsimed is; 

1. A method for generating a 3i2bsorlber profile based on 

advertisements watched by the subacriher, the method 

5 collar i sing: 

monitoring subeoriber advertising viewing activities; 

collecting advertiaemeab selection data from the monitored 
subBcribex advertising viewing activities; and 

generating a subscriber profile based on the advertisement 
LO selection data. 



2. The method of claim 1, further compxiaing retrieving 
advertisement related information for advertisements identified 
in the advertisement selection data wherein the advertisement 
15 related infomation contains descriptive fieldls related to the 
advertisements. 



3. The method of claim wherein said retrieving 
includes context inining text associated with the 
20 advertisements. 

i. The method of claim 3, wherein the text is derived 
from closecl-captioning data associated with the advertisement. 



45 



5/4/05, EAST version: 2.0.1.4 



wo 01/65747 PC:rAJS01/C6459 

collecting program selection data for the monitored 
subscriber program viewing activities; 

combining the program selection data with the 
advert i a ament aelection data; 

evaluating the combined prograiti selection data and the 
advertisement selection data to filter out irrelevant data and 
generate a record of actual subscriber selection data; and 

processing the actual subacriber selection data to create 
the subscriber profile* 

12. The method of claim 11, wherein said monitoring 
subscriber program viewing activities includes monitoring 
viewing time durations for selected source material, 

13. The method of claim 11, wherein said evaluating the 
combined program selection data includes evaluating channel 
change commands and associated viewing times. 

14. The method of claim 13^ wherein said evaluating the 
combined program selection data includes filtering out any 
channel change conimands if the associated viewing times are 
below a pre-determined threshold. 
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20. The method of claim 11, wherein the subscriber 
profile ia a procJact preference profile for the a\3b8criber, the 
product preference profile indicating the type of products of 
interest to the subscriber! 

21. The method of claim II, wherein the subscriber 
profile is an advertising preference profile for the 
subscriber, the advertising preference profile indicating the 
type of advertieing of interest to the subscriber. 

22. A data processing aystem for generating a subscriber 
profile based on advertisernenta watched by the subscriber, the 
system comprising: 

a storage medium; 

means for monitoring subscriber advertising activities; 

means for collecting advertisement selection data for the 
monitored subscriber advertising activities; 

means for retrieving advertiaemerit related information for 
ads in the advertisement selection data, wherein the 
advertisement related information contains descriptive 
fields corresponding to the advertisements; 

means for determining the extent to which the 
advertisements are viewed by the subscriber; and 
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27. The system of claua 2$, vhereln the text derived from 
closed-captionlng data associated with the advertlHement 
incli^dea a product name field. 

28. The system of olalm 26, wherein the text derived from 
olosed-captioning data aasociated with the advertisement 
included a product brand field. 

29. The system of claim 22, further comprising: 

means for monitoring subscriber program viewing 
activities; 

means for collecting program eelection data for the 
monitored eubecriber program viewing activities; and 

means for combining the advertieement selection data and 
the program selection data. 

30. The aystem of claim 29, further comprising: 

means for filtering out irrelevant data and generating a 
record of actual subscriber selection data? and 

means for processing the actual subscriber selection data 
to create a subscriber profile. 
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a storage medium; 

means at the server aide for xnonitoring aubsariber 
activity including receiving aubswiber channel change requests 
and storing subscriber channel change requests; 

5 means at the server side for retrieving advertisement 

xelated infomation wherein the advertisement related 
information contains descriptive fields corresponding to an 
adverbieeiuent; 

means at the server side for determining the extent to, 
10 which an advertisement is viewed by the subscriber; 

means at the server side for storing the descriptive 
fields and the determination of the extent to which the 
advertisement is viewsd by the subscriber; and 

means at the server side fox processing the descriptive 
15 fields and the extent to which the advertisement is viewed by 
the subscriber information to generate subscriber profile. 

35. The system of claim 34, wherein the means for 
retrieving advertisement related information further comprises 
20 means for context mining of textual inforceation aaaociated with 
the selected source material. 
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means fox processing the actual aubscxibex selection data 
to create a aubscriber profile. 



41. The system described In claiin 34 r wherein the 

5 subscriber profile is a program preference profile for the 
subscriber r the program preference profile indicating the type 
of prograimaing of interest to the subscriber. 

42. The system of claim 34/ wherein the subscriber 

10 profile is a product preference profile for the subscriberr the 
product preference profile indicating the type of products of 
interest to the subscriber. 



43, The system of claim 34, wherein the sxibscribex 
15 profile is an advertising preference profile for the 

subscriber, the advertising preference profile indicating the 
type of advertising of interest to the subscriber, 
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